First Order Quantum Phase Transition in Adiabatic Quantum Computation 
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We investigate the connection between local minima in the problem Hamiltonian and first order 
quantum phase transitions during an adiabatic quantum computation. We demonstrate how some 
properties of the local minima can lead to an extremely small gap that is exponentially sensitive to 
the Hamiltonian parameters. Using perturbation expansion, we derive an analytical formula that 
can not only predict the behavior of the gap, but also provide insight on how to controUably vary 
the gap size by changing the parameters. We show agreement with numerical calculations for a 
weighted maximum independent set problem instance. 



I. INTRODUCTION 

Adiabatic quantum computation (AQC) was first pro- 
posed in 2000 by Farhi et al. ,1;] as a means to solve NP- 
hard optimization problems. Later, Aharonov et al. 
proved that AQC is polynomially equivalent to conven- 
tional (gate model) quantum computation. It is also be- 
lieved that AQC is more robust against errors caused by 
environmental noise [1, 0, [l] . 

In AQC, the system's Hamiltonian, usually written as 



n{t) = [l-A(<)]7i;i3+A(i)Hp, 



(1) 



evolves slowly with time t as \{t) changes monotonically 
from to 1 within a time tf. The initial Hamiltonian TLb 
is assumed to have an easily accessible ground state into 
which the system is initialized, while the ground state 
of the final Hamiltonian 7i p provides the solution to the 
problem of interest. In order to reach the final ground 
state with high fidelity, the adiabatic theorem requires 
i/ oc 5njfn, where ^min is the minimum gap between the 
two lowest energy instantaneous eigenstates of Ti. The 
power 5 can be 1, 2, or possibly some other number de- 
pending on the functional form of A(t) and the distribu- 
tion of the higher energy levels 0, 0, 0] ■ 

Thus, in order to address the efficiency of AQC, one 
needs to analyze Qmim which is unfortunately as hard as 
solving the original problem if computed directly. The 
most fundamental problem in AQC is therefore how to 
bound 5rnin analytically. Equally important is how to 
unveil the quantum evolution blackbox by relating the 
the formation of gmin to the structure of the problem, and 
thus obtain insights for designing efficient algorithms. 

Besides a few special cases in which spectral gaps are 
computed analytically all other known studies have 
to resort to numerical calculations, e.g., diagonalization 
[§| or quantum Monte Carlo (QMC) techniques [iQ]. Un- 
fortunately, these methods are limited to small problem 
sizes (to date, A^<30 for diagonalization and up to 128 
for QMC), and tend not to provide much insight into why 
an extracted minimum gap is large or small. 

It has been recognized that during the evolution an 
adiabatic quantum computer may go through a quan- 
tum phase transition (QPT) [U, [H, ll3| . The transition 
is first (second) order if the change in the order parame- 



ter at the transition point is discontinuous (continuous) 
[l^ . In this article, we investigate the effect of pro blem 
structure, specifically the role of local minima [Til . ITsj . 
on the formation of a first order QPT. 

The paper is organized as follows. In the next section, 
we discuss the relation between AQC, or more specifi- 
cally adiabatic quantum optimization, to quantum phase 
transitions. We qualitatively describe how a first order 
QPT may happen during adiabatic evolution due to the 
presence of a local minimum. In section HI, we use per- 
turbation expansion to study such QPT in more detail 
and obtain analytical formula for the gap position and 
size. In section IV, we examine our findings via a small 
size example graph of the (NP-hard) weighted maximum 
independent set (WMIS) problem. We show agreement 
between our perturbation calculation and numerical di- 
agonalization. We demonstrate controllable variation of 
.gmin by 6 orders of magnitude by slightly (25%) changing 
the Hamiltonian parameters. At the end, we summarize 
our conclusions in section V. 



II. AQC AND QUANTUM PHASE 
TRANSITIONS 



Consider a transverse field Ising Hamiltonian ([T]) with 



7is=A^af, (2) 



where ct^'^ are Pauli matrices for the «-th qubit. Let £ de- 
note an energy scale that characterizes Hamiltonian T-Lp 
the same way as A characterizes H-b- (Here, we do not 
specify but only mention its existence.) In the inter- 
polation Hamiltonian ([T]), depending on whether Hb or 
Tip dominates, the system will be localized in one of the 
two computation (in which is diagonal) or Hadamard 
(in which erf is diagonal) bases, hence delocalized in the 
conjugate basis. We introduce the dimensionless param- 
eter 



c 



(l-A)A 



(3) 



which provides a measure of the relative importance of 
Hb and Hp. Let \tpo) denote the instantaneous ground 
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state of Hit). At A«0, C is very large and Tis is dom- 
inant making |V'o) a large superposition in the compu- 
tation basis or localized in the Hadamard basis. This 
is the quantum paramagnetic phase. As C is lowered, 
around Cc~ 1 (or cquivalently Ac~ A/ {A+£)), the domi- 
nance shifts from Tis to Tip, which favors localization in 
the computation basis. 

The transition from paramagnetic to ordered phase is 
usually via a QPT. For a large homogeneous system with 
no field, QPT happens at a well-defined critical point Ac 
and is usually continuous, thus second order. The lowest- 
energy excitations, delocalized over the whole system, are 
gapped with a gap that shrinks at Ac, but only polyno- 
mially in the system size N [l^. However, this scenario 
may be significantly altered by inhomogeneity 

In the absence of any further phase transition, the min- 
imum gap is most likely at Ac. Despite the localization at 
Ac, IV'o) will still be a superposition in the computation 
basis for A>Ac, but with a much smaller number of com- 
putational states involved. As A is increased, the total 
energy of such localized state will change and at some 
later point (A*) it may cross another localized state. The 
ground state of the system will then make a sudden tran- 
sition to the new state via a discontinuous (first order) 
QPT [24]. The gap at the transition point will be ex- 
tremely small, making A* the new position of the mini- 
mum gap. The transition at A* is between two ordered 
phases, in contrast to the order-disorder transition at Ac. 
There may even be more than one such transition if the 
ground state crosses other localized states, but all those 
transitions can only happen after localization at Ac- An 
important question now is what properties of Tip are re- 
sponsible for such a first order QPT. In the next section, 
we will employ perturbation expansion to answer this 
question. 



III. PERTURBATION EXPANSION 

Let us define 7io= ATip and H'= {l—X)Ti.B as the un- 
perturbed and perturbation Hamiltonians, respectively. 
We use C as defined in ^ as the dimensionless small pa- 
rameter. At C=0 (A=l), the eigenstates of the system 
are eigenfunctions of Tip (computational states). Thus 
Itpo) is the global minimum of Tip and the lowest lying ex- 
cited states are either states that are a few bit flips away 
from (or neighborhood of) the global minimum, or some 
low energy local minima and their corresponding neigh- 
borhoods. These two types of states behave completely 
differently as C is increased. Since Ti' only involves af 
operators, to every order of perturbation it flips only one 
qubit. Therefore, the lowest order of perturbation that 
gives a nonzero off-diagonal element TLmn= {'m\'H\n) is 
equal to the number of bit flips /„m (Hamming distance) 
between states |m) and |n). This gives Timn= 0(C-^'"" ), 
hence at Aw 1 the only non-vanishing TLmn are those be- 
tween neighboring states for which /„„ is small. Essen- 
tially, Ti becomes block diagonal with every minimum 




FIG. 1; Schematic diagram of crossing global and local min- 
ima. At zeroth order perturbation, levels do not cross (solid 
lines). Contribution from the second order perturbation may 
cause the levels cross if the curvature of the upper level is 
larger than the lower one (dashed lines). 



and its neighborhood forming a cluster of states with 
nonzero off-diagonal elements with each other, but van- 
ishingly small off-diagonal elements with states in other 
clusters. Upon diagonalization of Ti, the new eigenstates 
become superpositions of only the neighboring states. 
Those neighborin g st ates never cross due to the no-level- 
crossing theorem [19|. On the other hand, if as A is de- 
creased, two clusters move as a whole with respect to 
each other, as their energy levels cross they create anti- 
crossings with very small gaps of 0(C''^'""). The lowest of 
these anticrossings form a first order QPT. 

Let us now make the above observation more quantita- 
tive. At A= 1 the Hamiltonian Ti=Tip has a global min- 
imum |G^"^) with energy Eq. Let IL'-"-') represent a low 
energy local minimum (not necessarily the first excited 
state) of Tip with energy E^. For now we take both the 
above states to be non-degenerate. We use perturbation 
expansion to calculate the perturbed states \a=G,L), 
and their eigenvalues E^ at A < 1. To the second order 
perturbation, E^—XE^ — Xc((l— A)^/A, where 



E 



E.P - EP 



4 dA2 



(4) 



The perturbation expansion holds as long as for all states 
contributing to the sum, E^-E^ > (1-A)A/A. The 
two perturbed levels cross at (see Fig. [IJ 



A* = 





hi 


-EE] 






~XG 1 



(5) 



Since EI>Eq, if xl<Xg then there will be no real so- 
lution for A* (up to the second order in perturbation). 
Since the curvature of the energy levels, as shown in 
is proportional to Xa, when xl<Xg the local minimum 
has less curvature than the global minimum. In that 
case, the lower one of the two curves in Fig. [T] will be 
more curved than the upper one, hence will not cross 
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it. As a result, no first order QPT due to such a lo- 
cal minimum will occur. Even if ([5]) gives a real solu- 
tion but with A*<Ac, such a solution is not acceptable 
because perturbation expansion breaks down for A<Ac 
(C>1). Therefore, only local minima that yield a A*>Ac 
may cause first order QPT. In the absence of such local 
minima there wont be any first order QPT. Of course, 
(O is a result of second order perturbation expansion, 
therefore not accurate. In principle, one can continue to 
higher orders of perturbation to find a more accurate A* , 
but the computation becomes more complicated. 

The degeneracy at the above level crossing is removed 
by tunneling between the two localized states. To find 
ffmin, we need to calculate the effective 2x2 Hamiltonian 
H in the subspace made of the perturbed states \G) and 
\L). At the degeneracy point, Hll—'Hgg= E* and the 
off-diagonal elements remove the degeneracy. To the low- 
est order perturbation, 5min= 2(Hlg'^gl)"^^^, where 




WMIS 



FIG. 2: An example graph of WMIS problem. The central 6 
vertices have a weight wg and the 9 outer ones are weighted 
wl- For wl<2wg, the 6 central vertices make the WMIS, 
while every combination of 3 vertices each from one triangle 
is a smaller independent set, altogether making 27 degenerate 
local minima. 



Ti-LG = 



X*f-i 



n 



,(0) 



(0)\ 



(6) 



and L^G for Hgl- Here, \nf^) = 

f is the Hamming distance between these two states, and 
I'^l/o /) cover all other states except the above two. 

If any of the local or global minima are degenerate, Ti. 
should be written in the subspace of all those degener- 
ate states, hence will not be a 2 x 2 matrix. However, if 
there exists a symmetry between those degenerate states, 
as in the example studied below, one can still use a 2x2 
Hamiltonian Ti. for the two uniform (lowest energy) su- 
perposition states |a(°^) = J2kes l^^°^)/\/-^a- Here, Sa 
is the subspace made of the A/'q degenerate states con- 
tributing to In that case, ([6]) can be used but 
with the sum over all |ni°^)^ Sg U Sl- 

As is clear from ([5]), the gap becomes extremely small 
as A*^l. This limit is reached, according to ([5]), when 
there is a small E£—Eq and/or a large xl^Xg- The 
former simply means that the local minimum should have 
an energy close to the global one. To understand the 
latter, we notice that the denominator in the sum in ^ 
is the energy cost of a bit flip away from the local or 
global minima. Having a large xl—Xg means that on 
average the cost of bit flips inside the local minimum is 
smaller than inside the global minimum. In other words, 
there should be more low energy excitations, close to the 
bottom of the local minimum compared to the global 
minimum. 

The above observation, although obtained from second 
order perturbation, has a wider validity. In the computa- 
tion basis. Tip is diagonal, hence plays the role of a poten- 
tial energy, while TCb causes bit flips thus is responsible 
for dynamics. As is clear from Fig. [l] the unperturbed 
energy levels Ea ^ (straight lines) do not cross at any 
A> 0. Thus, the curvature of the levels, which is respon- 
sible for their crossing, is a result of the contribution of 



nV')=|G(0)), 



Ti-B- Qualitatively speaking, for a local minimum to have 
a larger curvature than (thus cross) the global minimum, 
it needs to gain more contribution from Hb ■ This means 
the system should have more dynamics, hence more free- 
dom, within the local than the global minimum. A simple 
example is when the local minimum is at the bottom of 
a much wider well than the global one. Below, we con- 
struct another example (using WMIS) in which there are 
several degenerate local minima with very small energy 
barrier between them and a global minimum well sepa- 
rated from all of those. 



IV. WEIGHTED MAXIMUM INDEPENDENT 
SET EXAMPLE 

Consider a general graph Q = {V{G), E{Q)), with 
a set of vortices V{G) and a set of edges E{Q) (see 
Fig. [2] for an example). For each vertex i £ V{Q) = 
{1, . . . , n}, one can associate a positive real number Wi 
(i.e., weight) to obtain a vertex- weighted graph. The 
weighted maximum independent set problem (WMIS) 
seeks to find a S C V{G) such that S is inde- 
pendent (i.e., each two vortices in S are not con- 
nected) and the total weight of S (= X]ie5™i) 
maximized. WMIS can be solved as an Ising prob- 
lemwith 'Hp=E^^v(G)hi'7f+E^ 



where hi= X]ye-E(e) with the condition Jij > 

minjwi, Wj}. Fig. [2] is an example graph consisting 6 
(central) vertices of weight wg and 9 (outer) vertices 
of weight Wl, connected by edges with Jij=J. For 
Wl < ^wg , the potential has a deep narrow global mini- 
mum and 27 shallow local minima separated from each 
other by 2 bit flips. The barrier height between two 
neighboring local minima is SU— 4:{J—wl)- Also, one 
obtains 



E[ -E^^4{6wg-3wl), 
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FIG. 3: (a) The first 3 energy levels for the example graph of 
Fig. [2] with J=2, wg=A=1, and wl^ 1-8. (b) Functions 5" 
and Af, as defined in ([8}, for the same problem. 
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(7) 



Figure [3^ shows a plot of the first three energy levels 
for a chosen set of parameters. The gap shows a first large 
minimum at X~ 0.1 and a much smaller second minimum 
at A« 0.6. To understand what these minima correspond 
to, we plot in Fig. [5Jd two other quantities: 



^ n=l 



1 ^ 



(8) 
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(b) ^Tr^^^ 
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FIG. 4: The (a) position and (b) magnitude of the minimum 
gap for the graph of Fig.[2]with ,]= 2, «;g= A= 1. The a;-axis 
for both figures are the same. 



We have also plotted gmin in Fig. using both diag- 
onalization and perturbation. The perturbatioir calcula- 
tions are done at the exact A* (extracted from diagonal- 
ization) as well as its corresponding perturbative value. 
A striking point is that by changing by about 25% 
the minimum gap changes by 6 orders of magnitude, i.e., 
12 orders of magnitude difference in t/. Such a strong de- 
pendence is indeed expected for a first order QPT, as the 
tunneling amplitude between the local and global minima 
is exponentially sensitive to parameters that characterize 
the barrier between the minima. 



S provides a measure for how spread the wave function 
is in the computation basis. For a wave function that 
is a uniform superposition of m computational states, 
i.e., the fraction of states that participate in 
the superposition. M, on the other hand, is the nor- 
malized total magnetization which for such a small scale 
problem can play the role of an order parameter [25| . 
As we can see in Fig. [Sb, a significant drop of S hap- 
pens around A= Ac which coincides with the position of 
the first minimum gap. Since there are only 15 qubits in- 
volved, such a transition is not very sharp, as it would be 
for large scale systems. The order parameter M contin- 
uously increases in magnitude around Ac, but suddenly 
jumps to another value at A*. This is a clear indication 
of a first order QPT at A*. 

As 2, 5U ^0 and the cost of bit flips within the lo- 
cal minima vanishes, allowing more dynamics within the 
local minima. Moreover, from ([7]) we see E£~Eq-^ 0. 
Both of these effects lead to A*^l and thereby a small 
gmin, as discussed above. Figure [3^, plots the results of 
numerical diagonalization and perturbative calculations 
of A* versus wl. Both curves approach 1 as 2. 



V. CONCLUSION 

We have shown that extremely small gmin may arise in 
AQC if the anticrossing is a result of a first order QPT. 
Such a phase transition happens if the final Hamiltonian 
possesses some low energy local minima with small cost 
of bit flip within them compared to the global minimum. 
Our perturbative calculation indicates that the gap de- 
pends exponentially on the Hamming distance between 
the two minima involved in the phase transition. If none 
of the local minima has the above properties, a first or- 
der QPT and therefore an exponentially small minimum 
gap may not occur. We have also supported our theo- 
retical findings with an example of WMIS problem. A 
very small gmin, extremely sensitive to the Hamiltonian 
parameters, was observed as a result of a first order QPT. 

Our example, though capturing all the qualitative fea- 
tures of the theory, is not generic. In many instances 
a minimum at Ac may not be visible. Moreover, sec- 
ond order perturbation expansion may not be adequate 
to find A* with acceptable accuracy for more complicated 
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instances. One should also note that a second order QPT 
may also lead to an exponential dependence of ^min on 
the size if the Hamiltonian has random inhomogeneities 
[13] ■ Nevertheless, the physical process leading to the 
first order QPT described here is general and not limited 
to the presented example. Since the first arXiv appear- 
ance of this paper, similar ideas have been employed by 
other groups [21, 22, 23] to a different problem and sim- 
ilar results were obtained, confirming the generality of 
our findings. 
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